Papers with part-level tasks
InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning (2025.acl-long)
Copied to clipboard
Zifu Wan, Yaqi Xie, Ce Zhang, Zhiqiu Lin, Zihan Wang, Simon Stepputtis, Deva Ramanan, Katia P. Sycara
| Challenge: | Large multimodal foundation models perceive objects as indivisible, overlooking the components that constitute them. |
| Approach: | They propose a novel benchmark for large multimodal foundation models comprising hand-labeled part segmentation annotations and task-oriented instructions to evaluate their performance. |
| Outcome: | The proposed benchmark improves performance of current models in understanding and executing part-level tasks within everyday contexts. |